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Abstract 

We propose a network characterization of combinatorial fit- 
ness landscapes by adapting the notion of inherent networks 
proposed for energy surfaces (3). We use the well-known 
family of TV A' landscapes as an example. In our case the in- 
herent network is the graph where the vertices represent the 
local maxima in the landscape, and the edges account for the 
transition probabilities between their corresponding basins of 
attraction. We exhaustively extracted such networks on rep- 
resentative small NK landscape instances, and performed a 
statistical characterization of their properties. We found that 
most of these network properties can be related to the search 
difficulty on the underlying NK landscapes with varying val- 
ues of K. 



Introduction 

Local optima are the very feature of a landscape that makes 
it rugged. Therefore, an understanding of the distribution 
of local optima is of utmost importance for the understand- 
ing of a landscape. Combinatorial landscapes refer to the fi- 
nite search spaces generated by important discrete problems 
such as the traveling salesman problem and many others. A 
property of some combinatorial landscapes, which has been 
often observed, is that on average, local optima are much 
closer to the optimum than are randomly chosen points, and 
closer to each other than random points would be. In other 
words, the local optima are not randomly distributed, rather 
they tend to be clustered in a "central massif (or "big val- 
ley" if we are minimising). This globally convex landscape 
structure has been observed in the NK family of landscapes 
(ji*), and in other combinatorial optimization problems, such 
as the traveling salesman problem Q^, graph bipartitioning 
(0) 

, and flowshop scheduling i). 

In this study we seek to provide fundamental new in- 
sights into the structural organization of the local optima in 
NK landscapes, particularly into the connectivity of their 
basins of attraction. Combinatorial landscapes can be seen 
as a graph whose vertices are the possible configurations. If 
two configurations can be transformed into each other by a 
suitable operator move, then we can trace an edge between 
them. The resulting graph, with an indication of the fitness 



at each vertex, is a representation of the given problem fit- 
ness landscape. A useful simplification of the graphs for 
the energy landscapes of atomic clusters was introduced in 
Q The idea consists in taking as vertices of the graph 
not all the possible configurations, but only those that cor- 
respond to energy minima. For atomic clusters these are 
well-known, at least for relatively small assemblages. Two 
minima are considered connected, and thus an edge is traced 
between them, if the energy barrier separating them is suffi- 
ciently low. In this case there is a transition state, meaning 
that the system can jump from one minimum to the other 
by thermal fluctuations going through a saddle point in the 
energy hyper-surface. The values of these activation ener- 
gies are mostly known experimentally or can be determined 
by simulation. In this way, a network can be built which is 
called the "inherent structure" or "inherent network" in a. 
We propose a network characterization of combinatorial fit- 
ness landscapes by adapting the notion of inherent networks 
described above. We use the well-known family of NK 
landscapes as an example because they are a useful tun- 
able benchmark that can provide interesting information for 
more realistic combinatorial landscapes. In our case the in- 
herent network is the graph where the vertices are all the 
local maxima and the edges account for transition probabil- 
ities between their corresponding basins of attraction. We 
exhaustively extract such networks on representative small 
NK landscape instances, and perform a statistical charac- 
terization of their properties. Our analysis was inspired, in 
particular, by the work of (3; 4) on energy landscapes, and 
in general, by the field of complex networks (8). The study 
of networks has exploded across the academic world since 
the late 90's. Researchers from the mathematical, biologi- 
cal, and social sciences have made substantial progress on 
some previously intractable problems, bringing new tech- 
niques, reformulating old ideas, and uncovering unexpected 
connections between seemingly different problems. We aim 
here at bringing the tools of network analysis for the study 
of problem hardness in combinatorial optimization. 
The next section describes how combinatorial landscapes 
are mapped onto networks, and includes the relevant def- 



initions and algorithms used in our study. The empirical 
network analysis of our selected NK landscape instances 
is presented next, followed by our conclusions and ideas for 
future work. 

Landscapes as Networks 

To model a physical energy landscape as a network, 
needed to decide first on a definition both of a state of the 
system and how two states were connected. The states and 
their connections will then provide the nodes and edges of 
the network. For systems with continuous degrees of free- 
dom, the author achieved this through the 'inherent struc- 
ture' mapping. In this mapping each point in configuration 
space is associated with the minimum (or 'inherent struc- 
ture') reached by following a steepest-descent path from that 
point. This mapping divides the configuration space into 
basins of attraction surrounding each minimum on the en- 
ergy landscape. 

Our goal is to adapt this idea to the context of combina- 
torial optimization. In our case, the nodes of the graph can 
be straightforwardly defined as the local maxima of the land- 
scape. These maxima are obtained exhaustively by running a 
best-improvement local search algorithm (HillClimbing, see 
Algorithm 1) from every configuration of the search space. 
The definition of the edges, however, is a much more del- 
icate matter. In our initial attempt ( fiol) we considered that 
two maxima i and j were connected (with an undirected and 
unweighted edge), if there exists at least one pair of solu- 
tions at Hamming distance one s, and Sj, one in each basin 
of attraction {bi and bj). We found empirically on small 
instances of NK landscapes, that such definition produced 
densely connected graphs, with very low (< 2) average path 
length between nodes for all K. Therefore, apart from the 
already known increase in the number of optima with in- 
creasing K, no other network property accounted for the 
increase in search difficulty. Furthermore, a single pair of 
neighbors between adjacent basins, may not realistically ac- 
count for actual basin transitions occurring when using com- 
mon heuristic search algorithms. These considerations, mo- 
tivated us to search for an alternative definition of the edges 
connecting local optima. In particular, we decided to as- 
sociate weights to the edges that account for the transition 
probabilities between the basins of attraction of the local 
optima. More details on the relevant algorithms and formal 
definitions are given below. 

Definitions and Algorithms 
Definition: Fitness landscape. 

A landscape is a triplet {S, V, /) where 5 is a set of potential 
solutions i.e. a search space, V : S — > 2'^, a neighborhood 
structure, is a function that assigns to every s G 5 a set of 
neighbors V{s), and / : S — > i? is a fitness function that 
can be pictured as the height of the corresponding solutions. 



In our study, the search space is composed by binary 
strings of length N, therefore its size is 2^. The neighbor- 
hood is defined by the minimum possible move on a binary 
search space, that is, the 1-move or bit-flip operation. In 
consequence, for any given string s of length N, the neigh- 
borhood size is |V^(s)| — N. 

The HillClimbing algorithm to determine the local op- 
tima and therefore define the basins of attraction, is given 
below: 



Algorithm 1 HillClimbing 
Choose initial solution s E S 
repeat 

choose s E V{s) such that f{s ) = maxr^^y^s) f{x) 
if/(s) </(s')then 

s ^ s 
end if 

until s is a Local optimum 



Definition: Local optimum. 
A local optimum is a solution s* such that Vs E V{s*), 
f{s) < fin 

The HillClimbing algorithm defines a mapping from the 
search space S to the set of locally optimal solutions S*. 

Definition: Basin of attraction. 
The basin of attraction of a local optimum z G S* is the set 
5i = {s G 5 I HillClimbing{s) = i}. The size of the basin 
of attraction of a local optima i is the cardinality of b^. 

Definition: Edge weight. 
Notice that for a non-neutral fitness landscapes, as are NK 
landscapes, the basins of attraction as defined above, pro- 
duce a partition of the configuration space S. Therefore, 
S = U.es* bi and Vi G 5 Vj ^i,hn bj = 
For each solutions s and s , let us define p{s — > s ) as the 
probability to pass from s to s with the bit-flip operator In 
the case of binary strings of size N, and the neighborhood 
defined by the bit-flip operation, there are N neighbors for 
each solution, therefore: 
if s G V{s) , p{s s ) ^ and 
if s' V{s) ,p{s s') = 0. 

We can now define the probability to pass from a solution 
s G 5* to a solution belonging to the basin bj, as: 

p{s bj) ^ J2 pi^^ s') 

s' £bj 

Notice thatp(s — > &j ) < I. 

Thus, the total probability of going from basin bi to basin bj 
is the average over all s G &i of the transition probabilities 
to solutions s E bj : 

p{h bj) = ^^P{s~^ bj) 



jjfbi is the size of the basin bi. We are now prepared to define 
our 'inherent' network or network of local optima. 

Definition: Local optima network. 
The local optima network G — {S* , E) is the graph where 
the nodes are the local optimaQ, and there is an edge G E 
with the weight Wij = p{bi bj) between two nodes i and 
j if p{b, -^bj) > 0. 

According to our definition of weights, Wij = p{bi bj) 
may be different than Wji = p{bj bi). Two weights are 
needed in general, and we have an oriented transition graph. 

Empirical Basin and Network Analysis 

The NK family of landscapes (0) is a problem-independent 
model for constructing multimodal landscapes that can grad- 
ually be tuned from smooth to rugged. In the model, N 
refers to the number of (binary) genes in the genotype (i.e. 
the string length) and K to the number of genes that influ- 
ence a particular gene (the epistatic interactions). By in- 
creasing the value of K from to — 1, NK landscapes 
can be tuned from smooth to rugged. The k variables that 
form the context of the fitness contribution of gene Si can be 
chosen according to different models. The two most widely 
studied models are the random neighborhood model, where 
the k variables are chosen randomly according to a uniform 
distribution among the n — 1 variables other than Si, and the 
adjacent neighborhood model, in which the k variables that 
are closest to si in a total ordering si, S2, . . . , s„ (using pe- 
riodic boundaries). No significant differences between the 
two models were found in (6) in terms of global properties 
of the respective families of landscapes, such as mean num- 
ber of local optima or autocorrelation length. Similarly, our 
preliminary studies on the characteristics of the NK land- 
scape optima networks did not show noticeable differences 
between the two neighborhood models. Therefore, we con- 
ducted our full study on the more general random model. 

In order to avoid sampling problems that could bias the 
results, we used the largest values of N that can still be 
analysed exhaustively with reasonable computational re- 
sources. We thus extracted the local optima networks 
of landscape instances with N — 14, 16, 18, and K = 
2, 4, 6, iV - 2, TV - 1. For each pair of N and K values, 
30 randomly generated instances were explored. Therefore, 
the networks statistics reported below represent the average 
behaviour of 30 independent instances. 

Basins of Attraction 

Besides the maxima network, it is useful to describe the 
associated basins of attraction as these play a key role in 
search algorithms. Furthermore, some characteristics of the 
basins can be related to the optima network features. The no- 
tion of the basin of attraction of a local maximum has been 
presented before. We have exhaustively computed the size 



and number of all the basins of attraction for A'^ = 16 and 
TV = 18 and for all even K values plus K = N — \. In 
this section, we analyze the basins of attraction from several 
points of view as it is described below. 

Global optimum basin size versus K. In Fig. [l] we plot 
the average size of the basin corresponding to the global 
maximum for iV = 16 and N = 18, and all values of K 
studied. The trend is clear: the basin shrinks very quickly 
with increasing K. This confirms that the higher the K 
value, the more difficult for an stochastic search algorithm 
to locate the basin of attraction of the global optimum 



N=16 — *— 
N=18 « 



Figure 1: Average of the relative size of the basin corre- 
sponding to the global maximum for each K over 30 land- 
scapes. 
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'since each maximum has its associated basin, G also describes 
the interconnection of basins. 



Figure 2: Cumulative distribution of the number of basins of 
a given size with regression line. A representative landscape 
with iV = 18, A' = 4 is visualized. A lin-log scale is used. 

Number of basins of a given size. Fig. |2] shows the cu- 
mulative distribution of the number of basins of a given 
size (with regression Une) for a representative instances with 
N = 18, K = 4 . Table [T] shows the average (of 30 inde- 
pendent landscapes) correlation coefficients and linear re- 
gression coefficients (intercept (a) and slope {(3)) between 
the number of nodes and the basin sizes for instances with 
iV — 16, 18. Notice that distribution decays exponentially 



Table 1: Correlation coefficient (p), and linear regression 
coefficients (intercept (a) and slope 0)) of the relationship 
between the basin size of optima and the cumulative num- 
ber of nodes of a given (basin) size ( in logarithmic scale; 
log(p(s)) — a + (3s + e). The average and standard devia- 
tion values over 30 instances, are shown. 
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Figure 3: Correlation between the fitness of local optima 
and their corresponding basin sizes, for two representative 
instances with N = 18, K ^ i (top) and K ^ 8 (bottom). 



or faster for the lower K and it is closer to exponential for 
the higher K. This could be relevant to theoretical studies 
that estimate the size of attraction basins (see for example 
(Q)). These studies often assume that the basin sizes are uni- 
formly distributed, which is not the case for the NK land- 
scapes studied here. From the slopes /3 of the regression 
lines (table[T]) one can see that high values of K give rise to 
steeper distributions (higher /3 values). This indicates that 
there are fewer basins of large size for large values of K. 
Basins are thus broader for low values of K, which is con- 
sistent with the fact that those landscapes are smoother. 

Fitness of local optima versus their basin sizes. The 

scatter-plots in Fig. [3] illustrate the correlation between the 
basin sizes of local maxima (in logarithmic scale) and their 
fitness values. Two representative instances for iV = 18 and 
if = 4, 8 are shown. Notice that there is a clear positive 
correlation between the fitness values of maxima and their 
basins' sizes. In other words, the higher the peak the wider 
tend to be its basin of attraction. Therefore, on average, 
with a stochastic local search algorithm, the global optimum 
would be easier to find than any other local optimum. This 
may seem surprising. But, we have to keep in mind that as 
the number of local optima increases (with increasing K), 
the global optimum basin is more difficult to reach by a 
stochastic local search algorithm (see Fig. [T]l. This obser- 
vation offers a mental picture of NK landscapes: we can 
consider the landscape as composed of a large number of 



mountains (each corresponding to a basin of attraction), and 
those mountains are wider the taller the hilltops. Moreover, 
the size of a mountain basin grows exponentially with its 
hight. 

General Network Statistics 

We now briefly describe the statistical measures used for our 
analysis of maxima networks. 

The standard clustering coefficient ^ does not consider 
weighted edges. We thus use the weighted clustering mea- 
sure proposed by ( 1), which combines the topological infor- 
mation with the weight distribution of the network: 
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and fci = ^ 



For each triple formed in the neighborhood of the vertex i, 
c^{i) counts the weight of the two participating edges of the 
vertex i. C" is defined as the weighted clustering coefficient 
averaged over all vertices of the network. 

The standard topological characterization of networks 
is obtained by the analysis of the probability distribution 
p{k) that a randomly chosen vertex has degree k. For our 
weighted networks, a characterization of weights is obtained 



by the connectivity and weight distribution p{w) that any 
given edge has weight w. 

In our study, for each node i, the sum of weights from the 
node i is equal to 1. So, an important measure is the weight 
Wii of self-connecting edges (remaining in the same node). 
We have the relation: wu + Si = 1. The vertex strength. 
Si, is defined as Si = J2jev{i)-{i} where the sum is 
over the set V(i) — {i} of neighbors of i []^. The strength of 
a node is a generalization of the node's connectivity giving 
information about the number and importance of the edges. 

Another network measure we report here is disparity 
Y2{i), which measures how heterogeneous is the contribu- 
tions of the edges of node i to the total weight (strength): 



basins for high K, and/or the transitions are less likely to 
occur. This confirms from a network point of view the com- 
mon knowledge that search difficulty increases with K. 



The disparity could be averaged over the node with the 
same degree k. If all weights are nearby of Si/k, the dispar- 
ity for nodes of degree k is nearby 1/k. 

Finally, in order to compute the average distance (shortest 
path) between two nodes on the optima network of a given 
landscape, we considered the expected number of bit-flip 
mutations to pass from one basin to the other This expected 
number can be computed by considering the inverse of the 
transition probabilities between basins. In other words, if 
we attach to the edges the inverse of the transition probabil- 
ities, this value would represent the average number of ran- 
dom mutations to pass from one basin to the other More 
formally, the distance (expected number of bit-flip muta- 
tions) between two nodes is defined by = 1/ Wij where 
Wij — p{bi bj). Now, we can define the length of a path 
between two nodes as being the sum of these distances along 
the edges that connect the respective basins. 

Detailed Study of Network Features 

In this section we study in more depth some network fea- 
tures which can be related to stochastic local search diffi- 
culty on the underlying fitness landscapes. Table |2] reports 
the average (over 30 independent instances for each N and 
K) of the network properties described, hy and are, re- 
spectively, the mean number of vertices and the mean num- 
ber of edges of the graph for a given K rounded to the next 
integer. C"" is the mean weighted clustering coefficient. Y 
is the mean disparity, and d is the mean path length. 

Clustering Coefficients. The fourth column of table |2] 
lists the average values of the weighted clustering coeffi- 
cients for all N and K. It is apparent that the clustering 
coefficients decrease regularly with increasing K for all N. 
For the standard unweighed clustering, this would mean that 
the larger K is, the less likely that two maxima which are 
connected to a third one are themselves connected. Taking 
weights, i.e. transition probabilities into account this means 
that either there are fewer transitions between neighboring 




Figure 4: Average distance (shortest path) between nodes 
(top), and average path length to the optimum from all the 
other basins (bottom). 

Shortest Path to the Global Optimum. The average 
shortest path lengths d are listed in the sixth column of ta- 
ble |2] Fig. m (top) is a graphical illustration of the average 
shortest path length between optima for all the studied NK 
landscapes. Notice that the shortest path increases with TV, 
this is to be expected since the number of optima increases 
exponentially with N. More interestingly, for a given N the 
shortest path increases with K, up to iiT = 10, and then it 
stagnates and even decreases slightly for the N — 18. This 
is consistent with the well known fact that the search diffi- 
culty in NK landscapes increases with K. However, some 
paths are more relevant from the point of view of a stochastic 
local search algorithm following a trajectory over the max- 
ima network. In order to better illustrate the relationship of 
this network property with the search difficulty by heuristic 
local search algorithms. Fig. 2] (bottom) shows the shortest 
path length to the global optimum from all the other optima 
in the landscape. The trend is clear, the path lengths to the 
optimum increase steadily with increasing K. 

Weight Distribution Here we report on the weight distri- 
butions p{w) of the maxima network edges. Fig. |5] shows 
the empirical probability distribution function for the cases 
= 16 and A^ = 18 (logarithmic binning has been used on 



Table 2: NK landscapes network properties. Values are averages over 30 random instances, standard deviations are shown 
as subscripts, and represent the number of vertexes and edges (rounded to the next integer), (7™, the mean weighted 
clustering coefficient. Y represent the mean disparity coefficient, d the mean path length (see text for definitions). 
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the X-axis). The case = 14 is similar but is not reported 
here because it is much more noisy for K = 2 and 4 due to 
the small size of the graphs in these cases (see table|2|. 

One can see that the weights, i.e. the transition probabili- 
ties between neighboring basins are small. The distributions 
are far from uniform and, for both = 16 and N — 18, 
the low K have longer tails. For high K the decay is faster 
This seems to indicate that, on average, the transition prob- 
abilities are higher for low K. 

Disparity Fig. |6] depicts the disparity coefficient as de- 
fined in the previous section for N — 16, 18. An interest- 
ing observation is that the disparity (i.e. dishomogeneity) in 
the weights of a node's outcoming links tends to decrease 
steadily with increasing K. This reflects that for high K 
the transitions to other basins tend to become equally likely, 
which is another indication that the landscape, and thus its 
representative maxima network, becomes more random and 
difficult to search. 

When K increases, the number of edges increases and the 
number of edges with a weight over a certain threshold in- 
creases too (see fig. IS. Therefore, for small K, each node is 
connected with a small number of nodes each with a relative 
high weight. On the other hand, for large K, the weights be- 



come more homogeneous in the neighbourhood, that is, for 
each node, all the neighboring basins are at similar distance. 

If we suppose that edges with higher weights are likely to 
be connected to nodes with larger basins (an intuition that we 
need to confirm in future work). Then, as the larger basins 
tend to have higher fitness (see Fig. [3]l, the path to higher 
fitness values would be easier to find for lower K than for 
larger K. 

Boundary of basins. Fig. |7] shows the averages, over all 
the nodes in the network, of the weights wu (i.e the probabil- 
ities of remaining in the same basin after a bit-flip mutation). 
Notice that the weights wu are much higher when compared 
to those Wij with j i (see Fig.|5]l. In particular, for K — 2, 
50% of the random bit-flip mutations will produce a solution 
within the same basin of attraction. These average probabil- 
ities of remaining within the same basin, are above 12% for 
the higher values of K. Notice that the averages are nearly 
the same regardless the value of A^, but decrease with the 
epistatic parameter K. 

The exploration of new basins with the random bit-flip 
mutation seems to be, therefore, easier for large K than for 
low K. But, as the number of basins increases, and the 
fitness correlation between neighboring solutions decreases 
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Figure 5: Probability distribution of the network weights Wij 
with j ^ i in logscale on x-axis. Averages of 30 instances 
for each N and K are reported. 



200 400 600 800 1000 1200 1400 
degree k 

Figure 6: Average disparity, Y2, of nodes with a given degree 
k. Average of 30 independent instances for each and K 
are reported. The curve 1/fc is also reported to compare to 
random case. 



with increasing K, it becomes harder to find the global max- 
ima for large K. This result suggests that the dynamic of 
stochastic local search algorithms on NK landscapes with 
large K is different than that with lower values of K, with 
the former engaging in more random exploration of basins. 

The boundary of a basin of attraction can be defined as 
the set of configurations within a basin that have at least one 
neighbor's solution in another basin. Conversely, the inte- 
rior of a basin is composed by the configurations that have 
all their neighbors in the same basin. Table [3] gives the av- 
erage number of configurations in the interior of basins (this 
statistic is computed on 30 independent landscapes). No- 
tice that the size of the basins' interior is below 1% (except 
for N = 14, K — 2). Surprisingly, the size of the basins' 
boundaries is nearly the same as the size of the basins them- 
selves. Therefore, the probability of having a neighboring 
solution in the same basin is high, but nearly all the solu- 
tions have a neighbor solution in another basin. Thus, the 
interior basins seem to be "hollow", a picture which is far 
from the smooth standard representation of landscapes in 2D 
with real variables where the basins of attraction are visual- 
ized as real mountains. 

Conclusions 

We have proposed a new characterization of combinatorial 
fitness landscapes using the family of NK landscapes as an 
example. We have used an extension of the concept of in- 
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Figure 7: Average weight wu according to the parameters 
N and K. 



herent networks proposed for energy surfaces i) in order 
to abstract and simplify the landscape description. In our 
case the inherent network is the graph where the nodes are 
all the local maxima and the edges accounts for transition 
probabilities (using the bit-flip operator) between the local 
maxima basins of attraction. We have exhaustively obtained 
these graphs for N = {14, 16, 18}, and for all even values 
of K, plus K = — 1, and conducted a network analy- 
sis on them. Our guiding motivation has been to relate the 
statistical properties of these networks, to the search diffi- 



Table 3: Average (on 30 independent landscapes for each N 
and K) of the mean sizes of the basins interiors. 
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culty of the underlying combinatorial landscapes when us- 
ing stochastic local search algorithms (based on the bit-flip 
operator) to optimize them. We have found clear indications 
of such relationships, in particular: 

The clustering coefficients suggest that, for high values of 
K, the transition between a given pair of neighboring basins 
is less Ukely to occur. 

The shortest paths increase with N and, for a given N, they 
clearly increase with higher K. 

The weight distributions indicate that, on average, the tran- 
sition probabilities are higher for low K. 
The disparity coefficients reflect that for high K the transi- 
tions to other basins tend to become equally likely, which is 
an indication of the randomness of the landscape. 
The construction of the maxima networks requires the de- 
termination of the basins of attraction of the corresponding 
landscapes. We have thus also described the nature of the 
basins, and found that the size of the basin corresponding 
to the global maximum becomes smaller with increasing K. 
The distribution of the basin sizes is approximately expo- 
nential for all N and K, but the basin sizes are larger for low 
K, another indirect indication of the increasing randomness 
and difficulty of the landscapes when K becomes large. Fur- 
thermore, there is a strong positive correlation between the 
basin size of maxima and their degrees. Finally, we found 
that the size of the basins boundaries is roughly the same 
as the size of basins themselves. Therefore, nearly all the 
configurations in a given basin have a neighbor solution in 
another basin. This observation suggests a different land- 
scape picture than the smooth standard representation of 2D 
landscapes where the basins of attraction are visuaUzed as 
hilltops. 

This study is our first attempt towards a topological 
and statistical characterization of combinatorial landscapes, 
from the point of view of complex networks analysis. Much 
remains to be done. The results should be confirmed for 
larger instances of NK landscapes. This will require good 



sampling techniques, or theoretical studies since exhaustive 
sampUng becomes quickly impractical. Other landscape 
types should also be examined, such as those containing 
neutrality, which are very common in real-world applica- 
tions. Finally, the landscape statistical characterization is 
only a step towards implementing good methods for search- 
ing it. We thus hope that our results will help in designing 
or estimating efficient search techniques and operators. 
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